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1 i , (cuiTeiitly aiEended) A tbree-dtmeTiskmai television system, comprising: 



2 an acQuisitioi3 stage, comprising: 

3 a plurality o:f video cameras, each video camera configured to acquire 

4 a video of a dynamically clitanging sceoe in real-time; 

5 means for synckorjizing tbe plumiily of \Hdeo cameras; and 

6 a plurality of producer moduies contiecied to the ph.iralit:y of video 

7 cameras, the producer modules configured to compress the 

8 videos to compressed videos and to determine viewing 

9 parameters of the plurality of video cameras , in wliich .the 
10 viewing parameters mchide a position, orieotation. field-of- 
5 ^ view, and focal plane of each video camera : 

12 a display stage, comprising: 

13 a pl urality of decoder modules con;ilgiired to decompress tbe 

1 4 compressed videos to unconipressed videos; 

15 a pilurality of consuiTKT modules configured to generate a plurality of 

1 6 output videos ixom tlie decompressed videos aceoi'din^ to the 

17 viewing parameters : 

1 8 a controller configured to broadcast the viewing f)aranie!:ei-s to the 

19 plural ity of decoder modules and the plurality of consumer 

20 modules; 

21 a three-dimensional display \init: configured to concurrently display 

22 the plurality of output videos onto a single display surface 

23 according to the viewing parameters ; and 
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24 means for CQimecting the plurality of decoder modtiles, the plural ity 

25 of consumer modules, and the three-dimensioiiai dispiay unit; 

26 and 

27 a transmission stage, eonnectrng the aequisition stage to the display stage, 

28 configured to transport the plurality of compressed videos and the viewing 

29 parameters. 

1 2. (cuirently amended) The system of claim I , further comprising a pkirality of 

2 cameras conFigored to acquire calibration images displayed on the display surface 

3 of the three-dimensional display unit to determine the viewing parameters. 

I 3. (original) The system of claim I , in which the dispiay units are projectors. 

1 4. (original) The system of claim I, in which the display units are organic light 

2 emitting diodes. 

1 5, (original) The system of claim 1, in which tlie tinree-dimensional dispiay unit 

2 uses fi-orJt-prqjection. 

1 6. (ori ginal) The system of claim 1 . in w^hich the three-dimensional display unit 

2 uses rear~prq|eetion. 

1 7, (original) The system of claim 1, in which tlie display unit uses two-dimensional 

2 display element. 
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1 8 . (pTeviotisly preseHted) The sy stetti of claim 1 , in whi cli tlie display unit uses a 

2 flexible fabric. 

9. (canceled) 

1 10. (original) The system of claim 1 , in which dii'ferenl output images are 

2 displayed depending on a viewing dimction of a viewer. 

1 i 1 . (previousiv presented) The svstenii orciaim 1 . in winch slatic vicvv-dependeni 

2 images of an environment- are displayed such that a display surface of the display 

3 unit disappears. 

1 1 2. (previously presented) The system of claim 1 , in which dynamic view- 

2 depeiiden !: i mages of an environment are displayed such that a display surfece of 

3 the display unit disappears. 

1 13. (origiisal) The system of clain:i 1 1 or 12, in xvhich the view-dependent images 

2 of {:he environment are acquired by a pi urality of caiEeras. 

1 14. (original) The system of claim 1 , to which each producer modide is connected 

2 to a stibset of the pinrality of video cameras. 

1 1 5. (original) The system of claim I , in which the pbrality of video cameras are in 

2 a regularly spaced linear and horizontai array. 
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1 1 6. (original) The system of ciaim 1 ^ ia which the phirahty of video cameras are 

2 ananged aibttrarily. 

1 1 7. (original ) The system of claim \ , in which an optical axis of each video cainera 

2 is perpciidicakH io j coiwiuon plane, and the up vectors of the plurality of video 

3 cameras luc \ciucaii> aligned. 

1 ] 8 (ojigmal) The sysstjn of chum I tn whidi the viewing parameters include 

2 iiitnnsic and CKti insic paiametcis of die video cameras. 

1 (ongni.il) H?e s\ stem of claim ' hiiiliei comprising: 

2 niean^ (or selecting a subset of the (iluralily of cameras for acqiiiring a subset 

3 of videos. 

1 20. (original) The system of claim L in which each video is compressed 

2 individnally atid teniporaJly- 

2 L (canceled) 

1 22, (previously presented ) The syst em of claim 1, in vviuch the controller 

2 determines, for each ouipnt pixel o{ii, v) m the outpnt video, a view nnmber v and a 

3 position of each sotrrce pixel s(\\ x, y) in the decompressed videos that contributes 

4 to the output pi xel in the output video. 
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1 23. (original) The system of claim 22, in which the output pixel is a hiiear 

2 combiiiatioti of /c source pixels according to 

3 o(u , v) = ^ w^s(y, X, y) , 

.'-■<) 

4 where bieiidiog weights w, are predetermiTied by the coiitrolier based on the 

5 viewing parameters. 

1 24. (origiiml) Tlie system ol: ciaim 22^ in which a block of the source pixels 

2 GQotribnte to each output pixel 

1 25 . (original) The system of claim 1, i n which the three-dimensional display imit 

2 inchides a display-side lenticular sheet, a viewer-side lenticuiar sheet, a dilTuser, 

3 and substrate between each Jenticular sheets and the dif fuser. 

1 26. (origiha!) The system of claim. I , in which the three-^dimensional display mii 

2 includes a display-side lenticular sheet, a reflector, and a substrate between the 

3 lenticular sheets arid the reGeetor. 

1 27. (previously presented) The system of claim 1, in which an arrangement of the 

2 cameras and an airangement of the display miits, with respect to the dispiay unit, 

3 are substantially identical, and the number of camems and the number of dispiay 

4 units is greater than two. 

1 28. (previously presented) The system of claim 1, in which the pinrality of cameras 

2 acquire the video of high dynamie light-fields. 
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29. (previously presented) The system of daim 1 , in which the display units 
display the output videos as high dynamic light-llelds. 
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30. (canceled) 



31. (canceled) 
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Remarks 

Claims 1-8 and 10-29 are peiuiing in the appiication. Claims 1-8 and 10-29 are 
rejected. All rejections are respectfiilly traversed. 

ClaiiBS 1-3, 5-24 and 27 are rejected under 35 U.S.C, 1 02(b) as being anticipated 
by Ritchey, U.S. Patent No. 5,495,576 (Ritehey). 

Ritchey describes virtual, raodel-based viitiial image renderiog, Vispal informatioii 
is acquired HSiBg a camera, and shape information is acquired using radar (cokimn 
10, lines j.7-25). Following acquisition oftlie sensor signals, Ritchey constructs a 
3D virtual model (see Abstract, " rhe computer processor integrates the sensor 
signals, processes signals as a virtual model. . and column 9, lines 6-14). 
Depending on the actions of a user, the 3D model is updated, for example, by 
moving a virtual object or changing the viewpoint of the display (coiumn 9, lines 
46-58), and virtual images are generated from the virtual model and rendered on a 
display (column 20, lines 46-50). 

Ritehey generates a virtual model from sensor signals, and then generates virtual 

images ft'om the virtual model The claimed output video is generated trom a 
compressed version of a video acquired of a dynamically changing scene. 

Regarding claim 1 , Ritchey fails to teach the claimed producer modules configured 
to determi ne viewing parameters of the plurahty of video cameras, in which the 
viewing parameters include a position, orientation, field-of-view, and focal plane, 
of each video camera. 
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'\s the displayed ^ n1ual images of Ritche> aiv' eniiiciy \ h\in]\ nio<iei~bascd, thcie 
IS no need for Ritchev to detcrmtnc vievMug paiaineiers of video c*imcias, m winch 
the viewing parameters include a position, orientation, field-of-view, and focal 
plane, ofeach video camera AH oflhe infomu^ion Ritchey requirei^ to display an 
image is dctcimmcd b> saniphng ihe 31) model (column 2, Hncb 30-39), 1 hcic is 
no mention of determining a position, orientation, field-of-view, or focai plane of a 
camera an^whoie in Ritchc\ \t coisimn 1 1 lines 55-(>J, and coiumn 12, lines 1-9, 
Ritchey describes mteniai (niinnsic) easneta parameters, such as chrominance, 
luminance, hue. and intensity, and additional hardware components that may be 
added 10 a camera fiicsc are not viewinj^ parame'cr'-^. and cerlairil^ are not a 
position, orientation, fleld-of-view, and focal plane ofeach camera as claimed. 

In addition, Ritchey fa ils to teach the claimed plurality of consumer modules 
configured to generate a pl urality of output videos from the decompressed videos 
according to the viewing parameters. 

As explained above, Ritchey fails to teach claimed producer modules configured to 
deteriBitie viewing parameters of the plurality of video cameras, in which the 
viewing pararaeters include a position, orientcition, field-ol^vievv, and focal plane, 
ofeach video camera. Therefore, Ritchey cannot teach a piuralit>'- of constimer 
modnles configured to generate a plurality of output videos from the decompressed 
videos according to the viewing parameters. 

FurthenTJore, all of the infomiation Ritchey requires to display his virtual irnage is 
determined by sampling the 3D virtual model. Depending on the actions of a user. 
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Ritcfaey updates and samples tie 3D yirtual model to determine what virtuaJ 
images to displd) (coiumn 20 isne^ 46-^6"^ \! column 1? hiie-^ 4^-4'), RitchcN 
dcscitbcs dcteunmuig a pcispecuve piojccuon ivhitnr fo u user s IulU^ amU'K s 
This is not equivalent to generating a plurality of output videos according to the 
\ icwmg pasamotots claimei-i \ icvsuh' pai.r^c es^ mcludc posniou, onentnUon, 
lleld~o!-\ ic\s . and focal plane of each vuk o mmL'ra u'-cd \o actpure the \ idcos dmi 
not of a user viemng the videos. Ritchcy cannot anttcipate the claimed invention 

Regarding claim 2, Ritchey fails So teach a pkirality of cameras configured to 
acquire ealibration images displayed on the disphiy surface of the three- 
dimensional display unit to determine the viewing parameters. At eoUimn 1 1 , lines 
61-63, Ritchey describes compressing a phirality of images into a single fi'ame. 
Examples of these single franies are sho'wn in Figs. 9a, 9b, and 10 of Ritchey, see 
also column 12, lines 30-34 and lines 49-54. These images cannot be used to 
determine viewing parameters including position, orientation, tield-of-view, and 
focal plane of each video camera. Additionally, these images are not calibration 
images. Calibration images, as known in the art, are used to compare a device or 
the output of an instrument to a standard having known measurement 
characteristics. In an embodiment of the invention, ealibration images are used to 
determine viewing parameters for generating a phirality of output videos, see 
Specification, paragraphs [092] -[094]. There is nothing in Ritchey that teaches the 
use of calibration images as claimed. 

Regarding eiuims 3 and 5-8, Ritchey fails to teach {he elainjed producer modules 
configured to detemiine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, tleld-of-view, and 
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focal plane, of each yideo camera^ and the claimed plurality of consimier modules 
coofigured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising the display units as claimed in claims 3 and 
5-8. 

Regarding claims 10-13, Ritchey fails to teach the claimed producer modules 

cotifignred to determine viewing paninieters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-ot-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
accordnig to the viewing parameters, rherefbre, Ritchey cannot anticipate the 
claimed invention further comprising the display of view-dependent images as 
claimed in claims 10-13. 

Regarding claim 14, Ritchey fails to teach the claimed producer modules 

configured to detemiine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field*ot-view, and 
focal plane, of each video canjera, and the claimed plurality of consumer modules 
configured to generate a plurality of output videos fi'om the decompressed videos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
claimed invention further comprising producer modules connected to a subset of 
the plurality of video cameras as claimed in claim 14. 

Regarding claims 15-17, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
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which the viewing parameters incltide a position, orientation, field-of-view, and 
focal plane, of each video camera, and tlie claimed plufaliiy of consumer modules 
configured to generate a plurality of output videos from the decompressed videos 
according to the viewing parameters, nierefore, Ritchey cannot anticipate the 
claimed invention further comprising the arrangement of video cameras as claimed 
in clairas 15-17. 

Fufthermore, the cameras depicted in Fig. { 7 are not in a regularly spaced linear 
and horizontal array as claimed in claim 15, Each camera in that figure is shown to 
be acquiring a different side of an object, see "Side A" through "Side F" clearly 
marked in Figure 17; column 10, lines 32-34; and Fig. 6. This is impossible with a. 
regularly spaced linear and horizontal amy as claimed in claim 15, 

At column 12, lines 44-47, Ritohey describes optical fiber bundles used to transmit 
images '^ofvariom sides of the subject (see lines 32-34) to the light sensitive 
recording surface of a camera. Acquiring images of various sides of an object, as 
described in Ritchey, requires a camera aiTangement that can receive light from all 
sides of an obiect. This cannot be done with the camera arrangement as claimed in 
claim 17. Althongh the fiber optic cables can be t\v'isted to achieve the described 
alignment^/or the cables themselves, this does not teach an optical axis of each 
video camera perpendicular to a common plane, and the up vectors of the pbdrality 
of video cameras being vertically aligned as claimed in claim 17. Again, it is clear 
that Ritchey does not describe a linear or quasi-linear array of cameras as claimed. 

Regarding claim 18, Ritchey fails to teach the claimed producer modules 
configured to determine viewing parameters of the plurality of video cameras, in 
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which the vievving parametets include a position, orientation, fieid-of-vie\v, and 
fotd! pianc of each video camera rxi ili^' i^laimed pltnjht^^ of (.onsnmc! modules 
coufiguicd to genciaic a pluiahly of ouiput videos liom the decompiessed \ ideos> 
according to the viewing paianicters Iliejefore. Rilchey cannot anticipate the 
clanntd invention hirthei compiistna the ' ic^w pauimetcis as claimed in cldim 
18 ^uTliiesmoie as expUnncd above, KUcl5e> does noi ieach n// paiamctCT<=!. 
/ e , parameters detemimed by camera placement as opposed to internal parameteis 
determined by cantera hardware, at cbhutin 11, lines 55-63, and colmTin 12, Hues 
3-11. 

Regarding claim 19, Ritchey fails to teach the claimed producer modules 
configured to detemiine viewing parameters of the piuraiity of video cameras, in 
which the viewing parameters include a position, orientation, fieid-of-view, and 
focal plane, of each video camera, and the claimed plurahty of consumer modules 
configured to generate a pl urality of output videos from the decompressed videos 
according to the viewing parameters, llierefore, Ritchey cannot anticipate the 
claimed invention further comprising the selection of a subset of ea:iu3era$ as 
claimed in claim 19. 

Regarding cUutt! 20 Riiciie> lads lo teach the chnmcd producci modules 
configured to determine vjewmg parameters of the plurahty of video cameras, in 
which the viewing parameters include a position, orientation, field-of-view, and 
focal plane, ot each video cameta. and the clnimcd pluralitv of cousumet mo<lules 
conl^^ured to generate a pluiaht> of output \ ideos irom the dcconipre^.:>ed \ aleos 
according to the viewing parameters. Therefore, Ritchey cannot anticipate the 
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claimed inventiori further comprising the compression of videos as claimed in 
claim 20. 

Regarding claims 22-24. Ritchey fails to teach the claimed producer modules 
configuicd [u dotcTinnk' vsewing pnraiueters of the pliualiiy of video cameras in 
which the Mowing pisfamctcrs include a position, oticiitalion, ileld-oi-vicw. and 
focal pkffiie, of each video camera, and the claimed pitjraiity of consumer modules 
configured to geneiate a phHalit> iiP output x'ldeos fiom die decompressed \ideos 
according to the viewing paiametcrs IhcTeforCs Ritchcy cannot anticipate the 
claimed invention further comprising the output pixel processing as claimed in 
claims 22-24. 

Regarding claim 27, Ritchey Mis to teach the claimed producer modules 

cotifigured to determine viewing parameters of the plurality of video cameras, in 
which the viewing parameters include a position, orientation, field-ot-view, and 
focal plane, of each video camera, and the claimed plurality of consumer modules 
contlgured to generate a pl urali ty of output videos Ixom the decompressed videos 
according to the viewing parameters, rheretbre, Ritchey cannot anticipate the 
claimed invention further comprising the arrahgement of video cameras and 
display unit as claimed in claim 27. 

Clann 4 is rejected under 35 tl.S.C. 103(a) as bemg unpatentable over Ritchcy 

Ret;aid!ng chum 4, Rnchc> tads to (each the clauncd pioducer nioduic^ configured 
to deteimuie viewing parameters of the plurality of video cameras, tn which the 
viewing parameters include a position, orientation, ficld-of-view, and focal planc. 
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of each video camera, and the claimed plHrality of consumer modules configured 
to generate a pl urality of output videos from t he decompressed videos according to 
the viewing parameters. There-fore, Ritchey cannot anticipate the claimed invention 
further comprising organic light emitting diodes as claimed in claim 4. 

Claims 25 and 2(-) arc rejected under 35 U,S,C, 103(a) as benig unpatentable o\er 
Ritchey, in view of Ezra et al., U.S. Patent No. 5,703,71 7 (Ezra), 

Regarding claims 25 and 26, the combination of Ritcbey and Ezra fails to teach tbe 
claimed prodneer modules configured to detemiine viewing parameters of the 
plurality of video cameras, in which the viewing parameters include a position, 
orientation, tleld-ot-view, and focal plane,, of each video camera, and the claimed 
plurality of consumer modules configured to generate a plurality of output videos 
from the decompressed videos according to the viewing parameters. Therefore, 
Ritchey cannot anticipate the claimed nrventioo hirther comprising the lenticular 
display tmits as claimed in claims 25 and 26. 

Claims 28 and 29 are rejected under 35 U.S.C. i03(a) as being unpatentable over 
Ritchey, in view of Nayar et al., U.S. Patent Appiieation Publication No. 
2004/0070565 (Nayar). 

Regarding claims 28 and 29, the combination of Ritchey and Nayar fails to teach 
tlie cknmcd producer modules configured to determine viewing parameters of the 
phuaiity oi \ideo cameras, ni which the vicwmg parameters include a position, 
orientation, field-of-view, and focal plane, of each video camera, and the claimed 
plurality of consimier modules confi^tred to generate a plurality of output videos 
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Ifoni the deeompressed videos acGording to the viewing parameters. Therefore, 
Ruches cannot anticjpuie (he ciaiiiiod nnent'on fiiither comprising the acquisition 
and display of high dvnamic hght fields as clauned m claim>^ m and 29 



It is bchc\ cd that fhis appHeation is now in condition for allowance A noiK'O to 
this cITcct icspeclliilly requested. Should further questions a^l'^c couccmuig this 
application, the Examiner is invited to call Applicant's attorney at the nuraber 
listed bciow Please chatge an\ shortage in fees due in connection witli the tiling of 
this paper to Deposit Account 50-0749. 

Respectfuily submitted, 

/Cliilon D. Muelleiy 



Clifton D. Mueller 
Attorney for the Assignee 
Reg. No. 57,836 

Mitsubishi Electric Research Laboratories, Inc. 

201 Broadway, 8* Floor 
Cambridge, MA 02139 
lelephone: (617) 621-7517 
Customer No. 22199 
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